Test Oracles Using Statistical Methods
نویسندگان
چکیده
The oracle problem is addressed for random testing and testing of randomized software. The presented Statistical Oracle is a Heuristic Oracle using statistical methods, especially statistical tests. The Statistical Oracle is applicable in case there are explicit formulae for the mean, the distribution, and so on, of characteristics computable from the test result. However, the present paper only deals with the mean. As with the Heuristic Oracle, the decision of the Statistical Oracle is not always correct. An example from image analysis is shown, where the Statistical Oracle has successfully been applied.
منابع مشابه
Translating Object-z Speciications to Passive Test Oracles Translating Object-z Speciications to Passive Test Oracles
This report describes the translation of formal speciications of container classes to passive test oracles. Speciically, we use Object-Z for speciications and C++ for oracles. We discuss several practical issues for the use of formal speciications in test oracle generation. We then present the translation process for three passive oracle models and evaluate how each model satisses our goals of ...
متن کاملPeters and Parnas : Using Test Oracles Generated from Program
|This paper illustrates how software can be described precisely using LD-relations, how these descriptions can be presented in a readable manner using tabular notations, and one way such descriptions can be used to test programs. We describe an algorithm that can be used to generate a test oracle from program documentation, and present the results of using a tool based on it to help test part o...
متن کاملUsing Meta-model Coverage to Qualify Test Oracles
The definition of oracles is a significant part of model transformation testing. The tester has to ensure their quality. Mutation analysis that can be used to qualify test oracles is an expensive task which is also dependent on the transformation under test’s implementation. In this paper we propose to use the coverage of the transformation’s output meta-model by the oracles as an alternative t...
متن کاملDesigning for Software Testability Using Automated Oracles
Software testing often requires massive numbers of test cases that must be manually inspected for correctness. This paper demonstrates the use of software \test oracles" to automate the process of checking the correctness of program output. The Prosper system, implemented by the authors, can be used to de ne test oracles and monitor the runtime behavior of software. An e ective method to design...
متن کاملWhat Test Oracle Should I Use for Effective GUI Testing?
Test designers widely believe that the overall effectiveness and cost of software testing depends largely on the type and number of test cases executed on the software. In this paper we show that the test oracle used during testing also contributes significantly to test effectiveness and cost. A test oracle is a mechanism that determines whether a software executed correctly for a test case. We...
متن کامل